A graph-based relevance feedback mechanism in content-based image retrieval

Content-Based Image Retrieval (CBIR) is an important problem in the domain of digital data management. There is indeed a growing availability of images, but unfortunately the traditional metadata-based search systems are unable to properly exploit their visual information content. In this article we introduce a novel CBIR scheme that abstracts each image in the database in terms of statistical features computed using the Multi-scale Geometric Analysis (MGA) of Non-subsampled Contourlet Transform (NSCT). Noise resilience is one of the main advantages of this feature representation. To improve the retrieval performance and reduce the semantic gap, our system incorporates a Relevance Feedback (RF) mechanism that uses a graphtheoretic approach to rank the images in accordance with the user’s feedback. First, a graph of images is constructed with edges reflecting the similarity of pairs of images with respect to the proposed feature representation. Then, images are ranked at each feedback round in terms of the probability that a random walk on this graph reaches an image tagged as relevant by the user before hitting a non-relevant one. Experimental analyses on three different databases show the effectiveness of our algorithm compared to state-of-theart approaches in particular when the images are corrupted with different types of noise. ✩This work is supported by internal academic project fund of Machine Intelligence Unit, Indian Statistical Institute, 203 B. T. Road, Kolkata-108. ∗Corresponding author: Tel.: +91-33-2575-3100; Fax: +91-33-2578-3357 Email addresses: [email protected] (Malay Kumar Kundu), [email protected] (Manish Chowdhury), [email protected] (Samuel Rota Bulò) Preprint submitted to Knowledge Based System July 18, 2014